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Abstract 



We propose a variable metric extension of the forward-backward-forward algorithm for 
finding a zero of the sum of a maximally monotone operator and a monotone Lipschitzian op- 
, erator in Hilbert spaces. In turn, this framework provides a variable metric splitting algorithm 

^ ■ for solving monotone inclusions involving sums of composite operators. Monotone operator 

. splitting methods recently proposed in the literature are recovered as special cases. 

00 

. Keywords: variable metric, composite operator, duality, monotone inclusion, monotone op- 

" erator, operator splitting, primal-dual algorithm 

^ ; Mathematics Subject Classifications (2010) 47H05, 49M29, 49M27, 90C25 

>'■ 

•i-H ■ 

^ '■ 1 Introduction 



A basic problem in applied monotone operator theory is to find a zero of a maximally monotone 
operator A on a real Hilbert space 7i. This problem can be solved by the proximal point algo- 
rithm proposed in |17) which requires only the resolvent of A, provided it is easy to implement 
numerically. In order to get more efficient proximal algorithms, some authors have proposed the 
use of variable metric or preconditioning in such algorithms [31 [5l El [lOl [131 ESI E] ■ 

This problem was then extended to the problem of finding a zero of the sum of a maximally 
monotone operator A and a cocoercive operator B (i.e., is strongly monotone). In such 



*This work was partially supported by Grant 102.01-2012.15 of the Vietnam National Foundation for Science 
and Technology Development (NAFOSTED). 



1 



instances, the forward-backward splitting algorithm [U [51 [T^ [T5] can be used. Recently, this 
algorithm has been investigated in the context of variable metric [11]. In the case when B is 
only Lipschitzian and not cocoercive, the problem can be solved by the forward-backward-forward 
splitting algorithm [H [19] . New applications of this basic algorithm to more complex monotone 
inclusions are presented in [H [9] . 

In the present paper, we propose a variable metric version of the forward-backward-forward 
splitting algorithm. In Section [2 we recall notation and background on convex analysis and 
monotone operator theory. In Section [3l we present our variable metric forward-backward- forward 
splitting algorithm. In Section [U the results of Section [3] are used to develop a variable metric 
primal-dual algorithm for solving the type of composite inclusions considered in [9]. 



2 Notation and background 

Throughout, Ti, G, and {Qi)i<i<m are real Hilbert spaces. Their scalar products and associated 
norms are respectively denoted by (• | •) and || • ||. We denote by 23 (71,0) the space of bounded 
linear operators from H to Q. The adjoint of L G 23 {71,0) is denoted by L*. We set 23 {T-L) = 
23 (Ti, %). The symbols ^ and — )• denote respectively weak and strong convergence, and Id denotes 
the identity operator, and B{x] p) denotes the closed ball of center x G Ti and radius p E ]0, +oo[. 
The interior of C C is denoted by intC. We denote by ^+(N) the set of summable sequences 
in [0, +oo[. 

Let Ml and M2 be self-adjoint operators in 23 (T-L), we write AIi )p= M2 if and only if (Vx G 
n) {Mix I x) > {M2X \x) .Let a£ ]0, +oo[. We set 

"Pain) = {M £ -B (n) \ M* = M and M:>=ald}. (2.1) 

Moreover, for every M G CPa('H), we define respectively a scalar product and a norm by 

(Vx e n){\/y en) {x\ y)j^^ = {Mx \ y) and ||x||Af = y^{Mx \ x). (2.2) 

Let A: T-L ^ 2^ he & set- valued operator. The domain is dom^ = |a; G ^ | Ax 7^ 0}, and the 
graph of A is giaA = {{x,u) £ T-L x Ti \ u £ Ax^. The set of zeros of A is zer^l = |x G 7^ | 
G Ax^, and the range of A is ran A = |n G ^ | (3 x G Ti) u G j4x}. The inverse of A is 
A^^ : Ti ^ 2^ : u \^x £ Ti \ u £ Ax^, and the resolvent of A is 

JA = (ld+A)~\ (2.3) 

Moreover, A is monotone if 

{y{x,y) €'Hx'H){y{u,v) e Ax X Ay) {x - y \ u - v) > 0, (2.4) 

and maximally monotone if it is monotone and there exists no monotone operator B: Ti ^ 2^ 
such that gravl C grai? and A ^ B. We say that A is uniformly monotone at x G dom^ if there 
exists an increasing function (p^ : [0, +00 [ — t- [0, +00] vanishing only at such that 

(Vu G ^x)(V(y,?;) G gra^) {x - y \ u - v) > (j)A{\\x - y\\). (2.5) 
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3 Variable metric forward-backward-forward splitting algorithm 



The forward-backward-forward splitting algorithm was first proposed in [19] to solve inclusion 
involving the sum of a maximally monotone operator and a monotone Lipschitzian operator. In 
[1], it was revisited to include computational errors. Below, we extend it to a variable metric 
setting. 

Theorem 3.1 Let K- be a real Hilbert space with the scalar product {{{• \ •))) and the associated 
norm \ \\ \ ■ \ \\\. Let a and j3 he in ]0,4-oo[, let {r]n)neN be a sequence in i^CN), and let {Un)neN be 
a sequence in 25 (/C) such that 



/i = sup ||?7ri|| < -l-oo and {I + r]n)Un+l > Un & "Pai^)- 
n6N 



(3.1) 



Let A: K ^ 2^ be maximally monotone, let B : K. ^ K. be a monotone and (3 -Lipschitzian 
operator on JC such that zer(A -|- B) / 0. Let (a„)„gN, (bn)neN, o,nd (c„)„gN be absolutely 
summable sequences in K. Let xq E JC, let e S ]0, l/(/3/x -|- 1)[, let (7„)„gN be a sequence in 
[e, (1 — e)/(/3/^)], and set 



y„ = £C„ - -friUn{BXn + tt^ 

Pn = J-inUnAVn + K 
(ln=Pn- 7nUn{Bpn + Cn 
Xn+l =Xn- + Qn- 



(Vn G N) 

Then the following hold for some x G zer(A -|- B). 



(3.2) 



(0 Z^nGN 1 1 \\Xn 

(ii) Xn ^x and p„ ^ x. 

(iii) Suppose that one of the following is satisfied: 

(a) ]mdzer{A+B){Xn) = 0. 

(b) A + B is demiregular (see Ul, Definition 2.3]) atx. 

(c) A or B is uniformly monotone at x. 

(d) int zer(A -)- B) / and there exists (i^n)nGN S ^+(N) such that (Vn G 

Un+l- 

Then Xn ^x and — t- x. 



Proof. It follows from [TTI, Lemma 3.7] that the sequences {xn)n<m-, {yn)n&h {Pn)n&i and (q„)„gN 
are well defined. Moreover, using [10, Lemma 2.1(i)(ii)] and (|3.ip . we obtain 



(V(Zn)neN G /C^) ^ ||||Z„|||| < -FOO ^ WW ^ n\\\\u ^ < 



nGN 



nGN 



and 



(V(Zn)„eN G /C^) J]] IlllZnIIII < -hOO <^ X] ' ' ' ' ^" ' ' ' ' < + 

neN nGN 



-oo 



oo. 



(3.3) 



(3.4) 
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Let us set 



(Vn G N) 



Qn=Pn- InUnBpn 



and 



' Un = In^U^'^iXn - Pn) + Bp^ - BXn 



(3.5) 



Qn-Qn + Vn- Vn- 



Then ()3.5p yields 

(Vn G N) Un = -f-^U-\y^-pJ + Bp^e Ap^ + Bp^ , 
and (|3.5p . p.2p . Lemma [HI Lemma 3.7(ii)], and the Lipschitzianity of B on /C yield 

< (/3m)-'I 



(3.6) 



(Vn G N) 



\y 



|Pn -PnllllcZ-l < llll^r 
-Qnllllt/-! < 2( 



\\\\jj-i + (/3^)"^||||an||||c/„ 

^nllllt/;:! + (/5^)"^llll«n||||t/„) + (/3/^)"^lll|c„||||j7, 



(3.7) 



Since (a„)„gpj, {bn)neN, and (c„)„gp^ are absolutely summable sequences in /C, we derive from 
(133]), (I33D, (133]), and ([32]) that 



(3.8) 





Hp 








\\d 



Pnllll<+00 and EnGN IlllPn - Pnllllf/-i < +00 
Qnllll<+00 and EnSN IHI^n - Qnllll[/-i < +00 

< +00 and llll'^nllllt/-i < +°*^- 



Now, let X G zer(A + B). Then, for every n G N, {x,—'jnUnBx) G gra(7„L/"„A) and 
()3.5p yields {Pn^Vn ~ Pn) ^ gi'a(7„L'"„A). Hence, by monotonicity of [/„A with respect to 
the scalar product (((• | we have — a; | p^ — — jnUnBx)))jj-i < 0. More- 

over, by monotonicity of UnB with respect to the scalar product (((• | we also have 

{{{Pn ~ ^ I InUnBx — jnU nBp^))) jj-i < 0. By adding the last two inequalities, we obtain 



(Vn G N) -x\p^-y^- 7„?7„Sp„)))^-i < 0. 

In turn, we derive from (j3.5p that 

(Vn G N) 2jn{{{Pn - X I (7„Ba;„ - UnBp,^)))^-i 

= ^{{{Pn -x\Pn-yn- InU nBp^))) ^j-l 

+ 2(((P„ - a? I JnUnBXn + yn- Pn)))u-^ 
< "^{{{Pn - X I -inUnBXn + jl„ - P„>»t/-i 



(3.9) 



Xr 



x\ 



It/: 



It/: 



it/: 



(3.10) 
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Hence, using (|3.5p . (|3.1U|) . the /3-Lipschitz continuity of B, (|3.ip . and [lUl Lemma 2.1(ii)], for 
every n E N, we obtain 



If/: 



Vr 



X 



It/: 



= WWPv 

< Illl^Cr 

< \\\\Xr 



x)+-fnUn{BXn- Bp JWWfj^, 
, J_ 9^/ ///^ _ I R 

It/; 



+ ln\\\\Un{BXn - BpJ 



|2 



X 



It/; 



^1 +llf^l3^\\\\Xn-Pn\ 



- _i - ^||||a;„ -p„|||| + 7„///3 ||||a;„ - p„| 

Hence, it follows from ()3.ip and p!Ol Lemma 2.1(i)] that 



(3.11) 



(Vn G N) ||||a;„+i-a;||||^ 1 < (l + ??„)||||a;„-a;||||^,_i ^(l-7^/3^^^)||||a;„-p„|||p. (3.12) 



Consequently, 



(Vn G N) ||||a;„+i - a;||||j^-i < (1 + 7y„)||||a;„ - a;||||[j-i. 



n+l 



(3.13) 



For every n G N, set 



e„ = V>a^(2(||||bn|||lc/-i + (/3/^) ^lll|an||||t/J + (/3/^) ^lll|cn||||t/„ + (/3/i) ^lll|an||||t/„ • (3.14) 



Then (en)nGN is summable by ()3.3p and ()3.4p . We derive from [ini Lemma 2.1(ii)(iii)], and ()3.8 
that 



(Vn G N) 



^ n + l 



ll'^^n+l "^n+l 1 1 1 1 r/~l 

< \/a-i||p„+i - a;„+i|||| 

< \/ i^a-^\\\\xn+i - a;„+i||||^-i 

< y/Jia^{\\\\yn - VnWWu-' + llll^n - Qnllll[/-0 



(3.15) 



In turn, we derive from (|3.13p that 



(Vn G N) 



It/ 



< ||||a;„+i - x\ 



It/; 



n + l "-^ n + l 

— 1 1 1 l-^n+l ''^1 1 1 1(7^-'- ~^ ^r, 



'1 + ||||iCn+l — Xn+l\ 



It/ 



n + l 



<{l+Vn 



n + l 

I '^n I 



t/; 



-1 +en. 



(3.16) 



This shows that {xn)neN is | • |-quasi-Fejer monotone with respect to the target set zer(A + B) 
relative to {U~^)neN- Moreover, by Proposition 3.2], (||||a;n — 3;||||jy-i)„gN is bounded. In 
turn, since B and {J'y„u„A)neN are Lipschitzian, and (Vn G N) a; = J'y„u„Aix — 'jnUnBx), we 
deduce from (j3.5p that (y„)neN; (Pn)neN> and (q„)ngN are bounded. Therefore, 



r = sup{||||a;„ -Vn + Qn- ^WWu^^^WW^n - a;||||jy-i, 1 + r/„} < +oo. 
neN 



(3.17) 
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Hence, using (|3.5|) . Cauchy-Schwarz for the norms 



and (|3.1ip . we get 



(Vn G N) ||||a;„+i - a;||||^,_i = ||||a;„ - y„ + q„ - a;||||f,_i 



— 1 1 1 l^n + '^n ~ 2/n ~ ^1 1 1 Ir/-! + ^'^1 1 1 1 1 1 1 117-I + 1 1 1 l^n| 1 1 |rr-l 
< \\\\Xn - 1 - i_r\l - 72/3V)lll|a;n -PnlllP +ei,n, 

^ n 

(3.18) 

where (Vn € N) = 2T||||<iri,||||[j-i + ||||cin||||^,_i. In turn, for every n G N, by p.ip and [lOl 
Lemma 2.1(i)], 

\Xn+l - X\\\\j I < (1 + r]n)\\\\Xn+l - x\\\\^j-i 

n+l 



jj-i-fi (1 -7„/3 /i )||||a;„ +rei,„ + TT/„. 



Since {rei^n + T'^iln)neN S ^+(N) by p.Sp . it follows from [7], Lemma 3.1] that 

^ ||||iC„ -PnlllP < +00. 
nSN 



(3.19) 



(3.20) 



(I)] It follows from (lOOjl and ([33]) that 

^\\\\Xn-Pn\\\f <^^\\\\Xn-Pn\\\f + '^^\\\\\Pn-Pn 
neN neN neN 



< +00. 



(3.21) 



Furthermore, we derive from (j3.8p and (j3.5p that 



neN 



^\\\\Pn- Xn + JnUn{BXn - Bp^) + dn\ 



nGN 



< 3( ^ ||||a;„ -PnlllP + \\\\lnUn{BXn - Sp„)|||P + ||||d„ 



< +00. 



(3.22) 



(ii) Let a; be a weak cluster point of {xn)nen- Then there exists a subsequence {xi^^)nen 
that converges weakly to x. Therefore ^ a; by (|3.20p . Furthermore, it follows from p.Sp 
that — )• 0. Hence, since (Vn G N) {pj^^^u^^) G gra(A + B), we obtain, a; G zer(A + B) 
[21 Proposition 20.33(ii)]. Altogether, it follows [10, Lemma 2.3(ii)] and [10, Theorem 3.3] that 
Xn ^x and hence that p„ ^ ^ by ( 



(iii)(a) Since A and B are maximally monotone and domS = /C, A + B \s maximally 



monotone [2, Corollary 24.4(i)], zer(A + B) is therefore closed [2| Proposition 23.39]. Hence, the 



claims follow from (i) , ()3.16p . and [TOl Proposition 3.4]. 
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(iii)(b) By (i) , Xn —^x, and hence (|3.20p implies that ^ x. Furthermore, it follows from 



()3.5p that Un — ?• 0. Hence, since (Vn E N) u„) G gra(A + B) and since A + S is demiregular 
at X, by [1, Definition 2.3], p„ — )• ^, and therefore (|3.20p implies that Xn — ?• x. 



(iii)(c) If A or S is uniformly monotone at x, then A + S is uniformly monotone at x. 



Therefore, the result follows from [1, Proposition 2.4(i)]. 



(in)(d)[ Suppose that z G int zer(A + S) and fix p G ]0, +oo[ such that B{z; p) C zer(A + B). 

£c-z||||) < +00 (3.23) 



It follows from (j3.16p and [10' Proposition 3.2] that 



e= sup sup II ||a;„ — a;|| II jy-i < (l/-v/a)( sup II ||a;„ — z|| II + sup 

x&B{z;p)n&i " nGN x£B(z;p) 



and from (j3.16p that 

(Vn G N)(Va; G B{z;p)) ||||a;„+i - a;||||2 , < 

^ n+1 



\Xr). 



^ n 

(3.24) 



Hence, the claim follows from (i) , [lOl Lemma 2.1], and [101 Proposition 4.3]. □ 
Remark 3.2 Here are some remarks. 



(i) In the case when (Vn G N) Un = Id, the standard forward-backward- forward splitting 
algorithm ()3.2p reduces to algorithm proposed in [U Eq. (2.3)], which was proposed initially 
in the error- free setting in |19| . 



(ii) An alternative variable metric splitting algorithm proposed in [T3] can be used to find a zero 
of the sum of a maximally monotone operator A and a Lipschitzian monotone operator B 
in instance when /C is finite-dimensional. This algorithm uses a different error model and 
involves more iteration-dependent variables than (j3.2p . 



Example 3.3 Let /: /C — )• [— oo,+oo] be a proper lower semicontinuous convex function, let 
a G ]0,+oo[, let (3 G ]0, +oo[, let -B : /C — >• /C be a monotone and /3-Lipschitzian operator, let 
(f?ra)ngN £ ■^+(N), and let {Un)neN be a sequence in J'a(/C) that satisfies (|3.ip . Furthermore, let 
xq G let e G ]0, min{l, l/(/i/3 + 1)}[, where p is defined as in ()3.ip . let (7n)neN be a sequence 
in [e, (1 — e)/(/3/u)]. Suppose that the variational inequality 



find xgK such that (Vy G /C) {x - y \ Bx) + f{x) < f{y) 
admits at least one solution and set 



(3.25) 



(Vn G N) 



p„ = argmin(/(a;) + 2^||||a; 

Qn=Pn- InUnBpn 



Vr 



|2 







(3.26) 



Then {x 



n)neN 



converges weakly to a solution x to ()3.25p . 



Proof. Set A = df and (Vn G N) a„ = 0, b„ 



0,c„ 



in Theorem 13. l](ii)[ □ 
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4 Monotone inclusions involving Lipschitzian operators 



The applications of the forward-backward-forward splitting algorithm considered in [U El US] can 
be extended to a variable metric setting using Theorem 13.11 As an illustration, we present a 
variable metric version of the algorithm proposed in [9, Eq. (3.1)]. Recall that the parallel sum 
of A: n 2'^ and B : n 2'^ is ^ 

ADB = {A-^ + B-^)-^. (4.1) 

Problem 4.1 Let Ti he a real Hilbert space, let m be a strictly positive integer, let z € Ti, let 
A: Ti ^ 2^ he maximally monotone operator, let C : T-L ^ H he monotone and fQ-Lipschitzian 
for some vq G ]0,+oo[. For every i E {1,... ,m}, let Qi be a real Hilbert space, let G Gi, let 
Bi'. Gi ^ 2^' be maximally monotone operator, let Di: Qi ^ 2^* be monotone and such that -Dj"^ 
is i/j-Lipschitzian for some Vi G ]0, +oo[, and let Lj : ?^ — t- t/j is a nonzero bounded linear operator. 
Suppose that 

z £ ran (^71 + ^L*((S, □ A)(ii • -r^)) + cY (4.2) 
^ i=i ' 

The problem is to solve the primal inclusion 

m 

find X G ?^ such that z G + ^ L* {{Bi □ Di){LiX - n)) + Cx, (4.3) 

i=l 

and the dual inclusion 



find vi e Qi, . . . ,Vm ^ Qm such that (3x G H) 



^ - YT=i -^i € Ax + Cx, 
_(Vi G {1, . . . , m}) Vi G (5, □ Di){LiX - n). 

(4.4) 



As shown in [9] , Problem 14.11 covers a wide class of problems in nonlinear analysis and convex 
optimization problems. However, the algorithm in [9l Theorem 3.1] is studied in the context of a 
fixed metric. The following result extends this result to a variable metric setting. 

Corollary 4.2 Let a be in]0,+oo[, let (r?o,n)neN be a sequence in£\,{N), let (C/„)neN be a sequence 
in TaiTi), and for every i £ {1, . . . ,m}, let {rii^n)nm be a sequence in £^(N), let (C/i,n)neN be a 
sequence in TaiGi) such that /i = sup„gp^{||C/„||, ||C/i,n||, . . . , ||C^m,ri||} < +oo and 

(Vn G N) (1 + m,n)Un+i > Un, and (Vi G {1, . . . , m}) (1 + r?i,„)?7i,„+i (4.5) 

Let (ai,n)neN5 {bi,n)n&ij and (ci^„)neN be absolutely summable sequences in %, and for every 
i G {l,...,m}, let (a2,j,n)neN5 (^2,i,n)neN; and (c2,j,n)neN be absolutely summable sequences in 
Qi. Furthermore, set 



(3 = maxifci'i, . . . , Vm} + 



\ i=i 
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let xq G n, let {vifl, Vm,o) ^ Si 
in [e, (1 -e)/(/3/i)]. Set 



Gm, let e G ]0,1/(1 +/3/u)[, let (7„)neN be a sequence 



(Vn G 



yi,n = Xn- InUn (Cx„ + YT=1 ^'>^i,n + Ol.n) 
Pl,n 

for i = 1, . . . , m 



U- R-i(y2,i,n 



g2,i,n = P2,j,n + lnUi^n{LiPl,n " D^^P2,i,n + C2,i,n) 
Vi,n+1 = Vi^n — ?/2,i,n + Q'2,i,n 
gi,n = Pl,n - 7nUn{Cpi^n + EI^l L*P2,i,n + Cl,n) 



Then the following hold. 



(4.7) 



Pi.nP < +00 and (Vi G {1, . . . , m}) ^„ 



P2,: 



< +00. 



(ii) There exist a solution x to (|4.3|) and a solution {vi, . . . ,Vjn) to (|4.4p such that the following 
hold. 

(a) Xn and pi^n x. 

(b) (Vi G {1, . . . , m}) Vi^n Vi and p2,i,n ^ Vi. 

(c) Suppose that A or C is uniformly monotone at x, then x„ — )■ x and pi^n x. 

(d) Suppose that BJ^ or DJ^ is uniformly monotone at Vj, for some j G {1, . . . ,m}, then 

Vj^n — ^ Vj and P2,j,n Vj . 

Proof. All sequences generated by algorithm (|4.7p are well defined by Lemma 3.7]. We define 
^1 ® • • • ® Gm the Hilbert direct sum of the Hilbert spaces Ti and (Gi)i<i<ini the scalar 
product and the associated norm of /C respectively defined by 



{{{■ \ ■)))■ iix,v),{y,w))^ {x\y) + J2{vi\wi) and |||| • |||| : (x,?;) h-^ 



1=1 



\ 



■^\\vi\ 



i=l 



(4.8) 



(4.9) 



where v = {vi, . . . , Vm) and w = {wi, . . . , Wm) are generic elements in ^1 © • • • © Gm- Set 
'A:K^2^: {x,vi, . . . ,Vm) ^ {-z + Ax) x {n + B^^vi) x . . . x (r„ + S^^v^) 
B-.K^K: {x,vi,... ,Vm) ^ {cx + Ya=i L*Vi,D^^vi - Lix, . . .,D:;^Vm - L^x^ 

(Vn G N) Un - JC-^ K: {x,Vi, . . . ,Vm) '-^ {UnX, Ui^nVl, ■ ■ ■ Um,nVm)- 

Since A is maximally monotone [2, Propositions 20.22 and 20.23], B is monotone and (3- 
Lipschitzian [9, Eq. (3.10)] with domS = JC, A+B is maximally monotone [2, Corollary 24.24(i)]. 
Now set (Vn G N) r]^ = max{ryo,n> • • • j ^m,n}- Then (r/„)„gN G ^+(N). Moreover, we derive 
from our assumptions on the sequences (C/„)„gN and (C/i,n)neNi • • • , (f^m,n)ngN that 

At = sup||?7n|| < +00 and {1 + r]n)Un+i > Un £ yaiK.). (4.10) 
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In addition, [21 Propositions 23.15(ii) and 23.16] yield (V7 G ]0,+oo[)(Vn G N)(V(x,vi, . ..,Vm)e 
K) 



J-/UnA{x,Vl, ...,Vm) = {j-yUr.Aix + jUnZ) , ( J^^^^^^-i (uj - Tf^i.n^'i)) i<i<„) • 



(4.11) 



It is shown in P Eq. (3.12)] and P Eq. (3.13)] that under the condition (gS]), zer(A + S) / 0. 
Moreover, Pi Eq. (3.21)] and H Eq. (3.22)] yield 



{x,vi, . . . , Vm) G zer(A + B) =^ x solves 
Let us next set 



and (f 1, . . . , Vm) solves (|4.4p . 



(4.12) 



(Vn G N) < 



•^n — (^ri) ^l,n) • • • ) ^m,n) 
Vn = {yi,n,y2,l,n, ■ ■ • ,y2,m,n) 
Pn = {Pl,n,P2,l,n, ■ ■ ■ ,P2,m,n) 
Qn = {Ql,n, 92,l,n, • • • , 92,m,n) 



and < 



Then our assumptions imply that 



l^lllla. 



< 00, ^llllfen 
neN 



< 00 



, and 



a„ = (ai 

t>n = {bi,n, ^2,l,?i, • • • , &2,m,n) 
Cji — (ci,nj ^2^1^71, . . . , C2^m,n)- 



< 00. 



(4.13) 



(4.14) 



Furthermore, it follows from the definition of B, ()4.1ip . and ()4.13p that ()4.7p can be rewritten in 
/C as 



JjnUnAVn + bn 



Pn — ""y„UnAyn "n 
Qn = Pn - lnUn{BPn + C„ 
— "^n Vn ^ni 



(Vn G N) 

which is ()3.2p . Moreover, every specific conditions in Theorem 13.11 are satisfied. 



(4.15) 



(i): By Theorem Bl^i)] EneN llll^n -Pnllll < oo- 



(ii)(a) ^(ii)(b) These assertions follow from Theorem 13. ]|(ii 



Eq (3.19)] that (x, f 1, . . . , Vm) satisfies the inclusions 



(ii)(c) Theorem I3.]|(ii)| shows that {x,vi, . . . ,Vm) G zer(A + B). Hence, it follows from [3 

(4.16) 



- T,T=i -CxG-z + Ax 
(Vi G {1, . . . , m}) LiX - D'^Vi e n + B^'^Vi 



For every n G N and every i G {1, . . . , m}, set 

\yi,n = Xn- lnUn{CXn + YT=l ^^i,n) 
\pi,n = J-y„UnA{yi,n + InUnZ) 



and 



y2,i,n — ^i,rt 

P2,i,7 



+ -inUi,n{LiXn - D- ^Vi^n) 

(4.17) 
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:,i,n ^ 0, 



(4.18) 



Then, using |1H Lemma 3.7], we get 

Pl,n - Pl,n and (Vi G {1, . . . , m}) P2,i,n - P2,: 

in turn, by (i)|(ii)(aj and (ii)(b) , we obtain 

Pl,n - Xn^O, pi^n ^ X, and (Vi £{!,..., m}) P2,i,n - Vi^n 0, P2,i,n ^ Vi- (4.19) 

Furthermore, we derive from (|4.17p that 



(Vn G N) 



7„^[/„ ^{Xn -Pl,n) - Yl'iLl L*Vi,n " CXn € -Z + Api^n 

{Mi G {1, . . . , m}) ln^U^^{Vi^n - P2,i,n) + LiXn - D'^Vi-n S + B~^p2,i,n- 



(4.20) 



Since ^ is uniformly monotone at x, using ()4.16p and ()4.20p . there exists an increasing function 
(pA '■ [0, +oo[ — )• [0, +oo] vanishing only at such that, for every n S N, 

4>A{\\Pl,n -x\\) ^ (^l,n-X I 7n^U~'^{Xn - Pl,n) " ^(L*Wi,„ - L*?;^) - (Cx„ - Cx) ^ 

m 

= {Pl,n - X I -/n^U~'^{Xn - Pl,n)) " ^ {Pl,n " ^ | -^^^^j^n - L*Vi) - Xn, 



i=l 



(4.21) 



where we denote (Vn G N) Xn = {pi,n — x \ Cxn — Cx). Since {B^ ^)i<i<m are monotone, for 
every i G {1, . . . , m}, we obtain 

(Vn G N) ^ {P2,i,n - Vi I + 7n ^^^i^" (^i," - P2,j,n) " Ux - {Dr^Vi^n " Dr^Vi)^ 

= (P2,i,n - Vi I Li(rc„ -x) +7n^U^ni'"i,n - P2,i,n)^ " (4-22) 

where (Vn G N) = {p2,i,n — Vi \ D^^Vi^n — D^'^Vij. Now, adding (|4.22p from i = 1 to i = m 
and ()4.2ip . we obtain, for every n G N, 

(t}A{\\Pl,n -x\\) < {Pl,n -X I 7^^J7^^(Xn - Pl^n)) + ( Pl,n -x \ ^L*{p2,i,n " I'i.n) ) 



i=l 



+ ^ (P2,i,n - Vi I Li{Xn - Pl,n) + 7n ^ t^i,n - P2,i,n)) " Xn " ^ ft.n- 



i=l 



j=l 



For every n G N and every i G {1, . . . , m}, we expand Xn and /3j^n as 

{Xn = {Xji ~ X I Cx„ — Cx) + (pi^n — Xn \ CXn — Cx) , 
f3i,n = {Vi,n - Vi I D'^Vi^n " D^T^Vi) + (i52,i,n " 'Vj.n | D'^Vi^n " A^^^^i) • 

By monotonicity of C and (i^j^"'^)i<j<m) 



(4.23) 



(4.24) 



(Vn G N) 



(Vi G {1, . . . , m}) (vi^n - Vi I Z^r^^'i," - Dr^Vi) > 0. 



(4.25) 
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Therefore, for every n G N, we derive from (|4.24|) and (|4.23p that 

m 

4>Ai\\Pl,n - ■^11) < (I^AiWPl^n - x\\) + {Xn-x\ Cx„ - Cx) + ^ {vi^n " Vi \ D~^Vi^n " D'^Vi) 

i=l 

< {Pl,n - X I %^U~'^{Xn - Pl,n)) + (pi,n " ^ I ^ L*{P2,i,n " I'i.n)^ 
m 

+ ^ (P2,i,n - Vi I Li{Xn - Pl,n) + ln^U~^{Vi^n " i52,i,n) 



i=l 



(Pl,n - Xn I Cx„ - Cx) - ^ (P2,j,n " Vi^n \ D- ^Vi^n " A ^Wj) . (4.26) 

i=l 



We set 



C = max sup{||a;„ - - \\vi^n - Vi\\, \\p2,i,n - Vi\ 

l<i<m„gN 



(4.27) 



Then it foUows from (ii)(a), (ii)(b), and (j4.19p that C < oo, and from [TOl Lemma 2.1(ii)] that 
(Vn G N) IIt,;;^?/^^!! < (ea) and (Vi G {!,..., m}) ||7,;;^t/j7„^ || < (ea)"^ Therefore, using the 
Cauchy-Schwarz inequahty, and the Lipschitzianity of C and {D^^)i<i<rn, we derive from (j4.26p 
that 

m 

4'A{\\Pl,n -x\\) < {ea)~'^C\\Xn -Pl,n\\ + \\Xn - Pl,n\\ + (^a)""^ ||^^i,n - P2,i,n\\) 



1=1 



\\P2,i,n - Vi^nW + l^o\\Pl,n " a^n|| + ^ ^i\\P2,i,n " ^^i,n| 

1=1 



0. 



(4.28) 



We deduce from ()4.28p and ()4.19p that ^^(||pi,ri, — x\\) — )• 0, which imphes that pi^„ — )• x. In 
turn, and p„ — )• X. Likewise, if C is uniformly monotone at x, there exists an increasing 

function (j)c ■ [0, +00 [ — )■ [0, +00] that vanishes only at such that 

m 

(pciWXn -x\\) < {ea)~'^C\\Xn -Pl,n\\ + \\Xn - Pl,n\\ + {ea)~'^\\Vi^n - P2,i,n\\) 

1=1 



i=l 



i=l 



in turn, a;„ — )• x and pn — )• x. 



(4.29) 



(ii)(d) Proceeding as in the proof of (ii)(c) , we obtain the conclusions. □ 



Acknowledgement. I thank Professor Patrick L. Combettes for bringing this problem to my 
attention and for helpful discussions. 
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